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ABSTRACT 

Test-wiseness is discussed in the newsletter of 
Programs for Educational Opportunity (PEO) , a combined race, gender, 
and national origin desegregation assistance center providing 
technical information to eligible public schools in Illinois, 
Indiana, Michigan, Minnesota, Ohio, and Wisconsin. PEO is based on 
the belief that specific teaching of test taking skills to help 
stiJdents become more test wise will expand the educational 
opportunities of all students. After an introduction by Percy Bates, 
the following papers are provided: (1) "Tribute to Dr. Charles D. 
Moody, Sr" (Bob Croninger); (2) "nn Interview with Irving P. McPhail 
(Elizabeth M. Mimms); (3) "What Some States and Districts Are Doing" 
(Elizabeth M. Mimms); (4) "Test-Wiseness Training: One District's 
Experience" (Iva A. Smith); (5) "Who Needs To Be Test W.rse?" (Bob 
Croninger); and (6) "A Test-Wiseness Primer" (D. Groves Dugger) . Ten 
services in the area of testing are listed. (SLD) 
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Teaching Children to be Test Wise 



From the Desk 
of the Director 

Percy Bates 

As the new director of the 
Programs for Educational 
Opportunity (PEO). it is my privilege 
to continue the work of my '^end and 
colleague, Chuck Moody. I share his 
commitment to the possibility and 
ncessity of change, for individuals, for 
schools, and for our social institutions. 

In his 17 years as director. Dr. 
Moody helped to improve the future 
of thousands of school children whose 
life choices might otherwise have been 
more limited because of their race, 
gender, or national origin. Bob 
Croninger's eloquent tribute on the 
next page expresses the mixture of 
pride and sadness we all felt when Dr. 
Moody left PEO and the School of 
Education to become The University 
of Michigan's first vice provost for 
minority affairs. 

In the fall 1983 issue o{ Break- 
through Dr. Moody wrote that school 
districts were asking PEO for techni- 
cal assistance to help reduce the dis- 
crepancy between black and white 
achievement on standardized tests. 
Among several ways that PEO has 
suggested for addressing thi.^ proolem 
is specific teaching of test-taking skills 
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to help Students become more "test 
wise.** Based on our experience, we 
believe that if school districts offer 
such test-wiseness training, it will 
expand the educational opportunities 
of aU students, no matter what their 
race,gp Her, or national origin. 

As yet ib.ot-wiseness curriculum 
materials are not widely used in urban 
school systems. Predominandy white 
high schools are more likely to offer 
their suidents special courses on how 
to take tests, and white parents are 
more likely to invest in private 
coaching to improve their children's 
college admission test scores.* If 
special courses and coaching do raise 
test scores, then all students should 
have access to them. 

(Continued on page 2) 
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Dr. Percy Bates, Director, 

Programs for 
Educational Opportunity 



Percy Bates, Ph.D., has been direc- 
tor of the Programs for Educational 
Opportunity since 1987. A psycholo- 
gist and special educator, he is a 
professor of education in the Univer- 
sity of Michigan School of Education 
where he has been a faculty member 
since 1965. He also heads the 
School's Office of Minority Student 
Affairs and chairs the Higher Educa- 
tion Commission of the National 
Association of Black School Educators. 

Prof. Bates has served the School of 
Education as chairperson of the 
Special Education Program and of the 
Div'non for Curriculum, Teaching, 
and .'Psychological Studies and as 
assistant dean. He has also had a tour 
of duty as HEW assistant undersecre- 
tary for special education in Washing- 
ton, D.C. 



From the Director 

(Continued from page 1) 

P£0 favors test-wiseness training 
and believes that schools can help 
students improve their tesi-taking 
skills. That is the focus of this issue 
of Breakthrough. 

What is test wiseness and can it 
help minority students improve their 
test performance? For answers to 
these questions, Elizabeth Mimms, the 
the editor of this issue, interviewed 
Irving P. McPhail, a much sought after 
consultant in the area of test wiseness. 
Dr. McPhail believes that not only the 
test scores but also the self-concept of 
minority youngsters can be improved. 
His opdmism and excitement are 
contagious. 

How wide spread are test-wiseness 
programs? Dr. Mimms surveyed state 
offices and local districts in the Great 
Lakes area and found that about half 
were making systematic efforts to 
implement test-wiseness programs, 
but that about half were not. 

How well do test-wiseness pro- 
grams work? Iva Smith describes 
one school district's experience with 
Dr. McPhaiPs program and its largely 
positive results. 

Who should be test wise? Bob 
Croninger's analysis argues persua- 
sively that not only students but also 
parents, teachers, guidance counsel- 
ors, principals, district level adminis- 
trators, and professbnal test-makers 



themselves need to be test wise. These 
adults should be concerned that we 
assess accurately, constructively, and 
fairly the abilities of children and be 
aware of the potential misuse and abuse 
of testing. 

What do researchers say about test- 
wiseness training? D. Groves Dugger 
reports that test-wiseness training 
allows students to cope with increased 
testing. Furthermore, it helps poorly 
performing students by bringing them 
up to speed. 

Finally, where can parents and 
educators get help? Besides the 
references at the end of each article. 
Dr. Mimms provides some additional 
resources, and Ms. Aurora Ramirez- 
Krodel, PEO librarian, provides an an- 
notated list of organizations offering 
services in the field of testing. 

There are other approaches to 
improving student performance on 
standardized tests: better curriculum 
and instruction and challenging the 
test-makers to eliminate bias from their 
instruments, to name just two very 
important approaches. Test-wiseness 
trai .Jig seems to woric, however, and 
so with Irving McPhail we at PEO say, 
"It's time to get on with it** 

Reference 

1. William F. Brazziel, "Improving 
SAT Scores: Pros, Cons, Methods,** 
Journal cf Negro Education 57 (1988): 
91. 
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Tribute to 
Dr. Charles D. Moody, Sr. 



Bob Croninger speaking for PEG staff 
May 28, 1987 



I have been asked by Dr. 
Moody's staff to present him 
with a plaque. It is with joy and 
sorrow that I do so, feelings I 
know that my colleagues share 
with me. 

We are pleased by Dr. 
Moody's recent appointment, 
and we are proud to help honor 
him here today. For seventeen 
years he has served as the 
director of the Program for Edu- 
cational Opportunity and the 
Center for Sex Equity in 
Schools, programs with the 
primary purpose of furthering 
equity in the public schools of 
this country. 

During that time he has led 
with quiet dignity, integrity and 
a sincere commitment to the 
aspiration^ and educational 
dreams of children. We have 
been witnesses to his leader- 
ship, to his commitment to 
equity and excellence, and it 
seems only right that he be 
honored for it at this time. 




Dr. Charles D. Moody, Sr., 
Vice Provost for Minority Affcdrs, 
The University of Michigan 



But we have also been 
friends, and as a friend we will 
deariy miss him. Over the years 
we have shared successes fmd 
disappointments. We have 
celebrated together when our 
efforts have helped children and 
teachers reach goals they 
thought unobtainable, and we 
have consoled each other when 
our efforts were not enough. 



when progress came too slowly 
or not at all for some. 

It is with joy and sorrow, 
therefore, that I make this 
presentation. Before your 
family, friends, fellow educa- 
tors and University colleagues, 
we gratefully recognize your 
leadership and friendship. We 
thank you for the memories you 
have provided us, and we hope 
that this plaque will be a re- 
minder to you and a notice to 
others of the high esteem in 

which you are held by us. It 
reads . . . 

"In grateful recognition of your 
friendship and commitment to 
equity and excellence in public 
education. From your staff and 
the more than 170:000 adminis- 
trators, teachers, suidents and 
parents in Illinois, Indiana, 
Michigan, Minnesota, Ohio and 
Wisconsin whom 3 ou have 
inspired by your leadership. 
Dr. Charles D. Moody, Sr., 
Director, 1970-1987." 
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An interview with 



Irving P. McPhail 



by Elizabeth M. Mimms 



Irving McPhail is currently 
president of LeMoyne-Owen College, 
Memphis, Tennessee, His previous 
positions include vice president and 
dean of academic cffairs at Delaware 
State Culege, chiif operating officer 
ofBattimore City Public Schools, and 
special assistant to the director for de- 
velopment and education and re- 
search scientist for the Center for 
Metropolitan Planning and Research 
at Johns Hopkins University. 

Dr. McPhail holds a bachelor's 
degree in sociology from Cornell 
University, a master's degree in 
reading from Harvard Graduate 
School of Education, and a doctorate 
in reading and language arts from the 
University of Pennsylvania. He has 
been an active consultant to school 
districts on the principles of test 
wiseness. Some of his publications on 
test wiseness and training for lest 
taking are listed in the references at 
the end of this interview . 

Elizabeth Mimms, a field services 
specialist with the Programs for 
Educational Opportunity since 1980, 
interviewed Dr. McPhail by tele- 
phone on January 14, 1988. 

Mimms: Dr. McPhail, what led to 
your initial interest in training students 
in test-taking skills? 

McPhail: My initial interest dates 
back to my days as a doctoral student 
at the University of Pennsylvania. I 
went to the University of Pennsylva- 
nia in 1973 to pursue a doctorate in 



reading and language aits, with minors 
in measurement, evaluation and tech- 
niques of experimental research and 
socio- and psycho-linguistics. 

The Hrst course that I took in tests 
and measurement was taught by Dr. 
James Diamond. Unbeknownst to me, 
James Diamond was and is one of the 
premier researchers in the area of test 
wiseness. Of course, I did not know this 
coming into his graduate course, and 
certainly I was not yet familiar with the 
literature on test wiseness. 

One day in a lecture about item 
analysis, Jim mentioned that there was a 
body of literature and some very 
interesting research that spoke to the 
issue of test wiseness, namely that th^e 
was aji art and science of test taking. 
Once mastered, these principles could 
improve student performance on 
standardized tests. He discussed this in 
the context of error variance, which was 
one of the things we were talking about 
in the general dis^'ussion of item 
analysis. 

I became somewhat intrigued by 
what was really a passing comment Jim 
didn't even give a lecture on test 
wiseness; he just happened to mention it 
in passing. I remember vary distincdy at 
the end of the lecture that I went up to 
him and said, **You know, Vm kind of 
interested in the test-wiseness construct 
that you talked about. Could you 
suggest some literature?*' He said, 
"Sure, come see me tomorrow." 

When I stoH)ed by his office, he 
gave me about a pound of articles, some 
of them his work and others the classic 



work by Millman and his associates. I 
read that stuff and became hooked. I 
mean, I became absolutely fascinated. 
For years I had wondered why it was 
that Black students did not do as well 
on standardized tests as did white 
students. I knew that it had nothing to 
do with intelligence, and I knew that in 
some cases it had nothing to do with 
access to quality education, because 
even in settings where Blacks and 
whites at the tq) of the class were 
going to school together, there seemed 
to be this variance. I got excited about 
this topic because I became committed 
to the view that the problem that beset 
many Black students was an absence of 
this thing that I had just discovered 
called test wiseness. 

From that point on, I set about the 
task of mastering the knowledge and 
research in this area, and ultimately I 
went on to do my doctoral dissertation 
intheareaof testwf:.?ness.'-^ Jim 

Diamond served as a member of my 
committee. It was that doctoral 
dissertation that led to the publication 
of my Test-Wiseness Curriculum.^ Of 
course, the rest is history. 

Mimms: Do you differentiate 
between test wiseness and test-taking 
skills? I want to use the terms inter- 
changeably, but I didn't know if you 
considered them the same. 

McPhail: Most people use the 
terms interchangeably. However, test 
wiseness is the technically appropriate 
term. Test wiseness is the term coined 



4 Breakthrough 



ERIC 



5 



Summer 1988 



by Jason Millman in his original 1965 
research report published in Educa- 
tional and Psychological 
Measurement^^ but most people do 
use these terms interchangeably. In 
fact, there are a number of tmns— test 
wiseness, test awareness, test-taking 
skills, test sophistication. As long as 
all of those terms are defined as 
Millman set down in his classic 
definition of test wiseness, then 
there's no problem with using the 
terms interchangeably. 

Mimms: What are the educational 
advantages — immediate and long 
term— of teaching test wiseness? 

McPhail: The immediate advan- 
tages are that young people will be 
able to learn some strategies and 
techniques that will help them 
improve their test scores. This is 
critically important for Black students 
because college admissions exams, 
emptoyment exams, exams for 
promotion — the whole range of testing 
in American society — has victimized 
Black students. Fm not talking about 
Black students who can't read and 
write; I'm talking about good Black 
students. 

Objective, multiple-choice kinds of 
tests are ccgnitively inappropriate 
activities for Black students. I'm 
basing that statement on Barbara 
Shade's wor! on African-American 
cognitive sty le.^* ^* ^ I argue that the 
format and the structure of a multiple- 
choice test operates against the 
preferences for cognition that Barbara 
Shade and others have written about 
of late. Our Black students are 
victimized to a greater degree than any 
other students by these tests, so the 
immediate impact and the immediate 
gain is of course that the students will 
learn some things that will help them 
improve their performance. That 
means they ought to be able U) go on 
and to do many of the things that they 
want to do more enectively as a result 



of having succeeded on the test. 

In terms of long term beneflts 
there's no question that the teaching of 
test wiseness has some payoffs in 
terms of critical tiinking and critical 
problem-solving ability. In my 
research I've had teachers who have 
written to me and said that not only 
did their students improve their test- 
taking skills, but that their problem- 
solving abilities have also improved. 





Dr, Irving P, McPhail 

That's because taking a test is a 
problem-solving kind of activity. 
Learning the principles of test wise- 
ness and learning how to apply them is 
a problem-solving style. I think that 

there is no question that there are 
some long term benefits there. 

I think there are also some short 
and long term beneOts in terms of 
student self-concept. Black students 
feel better about themselves and better 
about their abilities to succeed as a 
result. As a student once said to me in 
my first experiment twelve years ago 
in Philadelphia, **I fmally learned how 
to beat the man at his own game." I 
think that there is some very important 
self-empowerment, if you will, that is 
a residual benefit of all of this that is 
very, very important. 



Mlmms: Would you please 
comment on arguments you have 
heard for and against teaching test- 
taking skills? 

McPhail: Well, the biggest 
argument that you get is that it's 
somehow cheating, that somehow 
we're giving through the teaching of 
test wiseness some kind of advantage 
that other students don't have. I think 
that's a rather hilarious argument, but 
that's the one that I hear most I think 
that it's an insult to the student, and I 
think that we are harmir^ students 
when we don't prepare them for test 
taking, particularly Black students and 
other minority students who are 
victimized, literally victimized, by the 
standardized testir^ industry in 
Arnica. And so I think that for those 
people who understand what test 
wiseness is, that ceases to be a valid 
argument 

There are some who confuse test 
wiseness with teaching correct 
answ^ to the test before the test is 
given. Thatofcourseisnottest 
wiseness. Test wiseness is . ''alistic 
psychometric consmict that is based 
on an outline of six principles. Once 
people understand what test wiseness 
is — not what they might fancy it to be, 
but what it is scientifically — then I 
think they see that it is a skill akin to 
using the card catalog in the library or 
knowing how to use the SQ3R 
(Survey, Question, Read, Recite, 
Review) system in reading a textbook 
chapter. In other words, it is a study 
skill, and as such it does not involve 
any cheating at all. 

Now, another criticism I've heard 
is that somehow teaching students to 
be test wise will invalidate the results 
of the test. Also I disagree with that 
argument. The distinguished Dr. 
Robert Ebel,* who along with Millman 
is one of the giants in the area of 
testing and measurement, argued back 
in the 1960s that students who are low 
in test wiseness are more of a problem 
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to the validity and reliability of a test 
than those students who are high in 
test wiseness. The reason for that is 
you don't know what that score means 
with a Black student. You don't know 
whether that score is an accurate 
indication of what that student knows 
or if that score is basically a measure- 
ment of the frustration that the student 
has had with the format of that test 
and the test-taking situation. By 
equipping the student with the 
requisite degree of test wiseness, you 
open up a greater possibility that the 
student's performance is going to give 
you a more accurate reading of what 
that student actually knows. 

Mimms: What do you consider to 
be essential components of a compre- 
hensive or ideal test-wiseness pro- 
gram? 

McPhail: I wrote about that in one 
of my articles and you need to really 
check back, but let me see if I can 
rec^ture this. I laid it out in about 
Ave or six components.' 

The first component dealt with the 
socio-political implications of testing 
Black Americans. That's the begin- 
ning of the program. I talked about 
what tests mean and how tests are 
being used to victimize the progress of 
Black Americans. Then in the second 
component I moved into a detailed 
analysis of Millman's outline and his 
test-wiseness principles. Then in the 
third component I discussed the 
applied principles of test wiseness. 
Since I'm a reading specialist, I 
applied the principles of test wiseness 
to verbal achievement and aptitude 
tests. Then I explained a test-wiseness 
technique I've developed for standard- 
ized reading comfH'ehension passages, 
analogies, etc. In the fourth compo- 
nent I instructed or reviewed the 
content to be measured by the test. 
For example, if the test is going to 
measure algebra, you need to go back 
and review the basic algebraic rules 



and equations. If the test is going to 
be a measure of vocabulary, you need 
to go back and do some b^ic vocabu- 
lary review. And then tlie kiflh 
component involves practice under 
simulated conditions: practice on test- 
like items under 2»:mulaied time 
conditions and other conditions. 

Mimms: Please describe the 
curriculum and instructional materials 
or programs you think would be most 
effective for teaching tes.-taking 
skills. 

McPhail: There is a lot on the 
market now. My own TeshWiseness 
Curriculum is perhaps the truest 
material on the market to the design, 
the construct, of test wiseness itself. It 
teaches the principles that are inherent 
in Millman's outline of test wiseness, 
provides int)blems for practice, and 
evaluates test wiseness by using 
reading comprehension tests. 

There are also oth^ materials on 
the ma^et that basically provide drill 
and practice. Probably the best drill 
and practice material on the market is 
the Scoring High matmal by Random 
House,^''but there's some other good 
material. For example, the National 
Association of Secondary School 
Principals has an SAT preparation 
package. They also have a verbal 
workbook, a math wo^^kbook, and 
diskettes that are very, very good in 
terms of drill and {Hactice and also in 
terms of review of the content 
information. There are a couple of 
other companies that have good 
material out. 

But again, I think that it's neces- 
sary to teach test wiseness first, to use 
the problems for practice, to reinforce 
those principles of test wiseness, and 
then to use them for purposes of 
simulation. One of my concerns about 
some of the efforts to teach the 
principles of test wiseness is that 
people are not really teaching 
Millman's outline of tesc-wiseness 



principles arid I thirJc that's problem- 
atic. 

Mimms: Where have such 
curriculum, ir4atcnals or {programs 
been used far as you know, aiid 
what have b^en the results? 

McPhail: They've bef i ^sed all 
Over the country and Jie resu^^s have 
been very, very goud. I first came out 
with my workbook in 1978, and I 
have sold several thousand copies 
ov^ the last ten years. 

As I travel around the country 
speaking to teachers and educators, I 
And that everybody knows about 
Scoring High, That Random House 
material is in lots of schools around 
the country. I wouldn*t want to 
venture a number, but I would say that 
thousands of school districts across 
the country have awakened to the need 
to teach the principles of test wiseness. 
The results obviously are very good 
because I kscp getting invited to do 
my workshops. Every where I go 
people who find out about this get 
excited about it and do something with 
it and the results are good. 

Mimms: Great! What should the 
district goals be for such training, and 
how should such goal attainment be 
evaluated? 

McPhail: I think the district goal 
should be to make sure that every 
student is exposed to the principles of 
test wiseness beginning with pre- 
school. I think the place to start is in 
the pre-kindergarten and to continue 
to teach the principles all the way up 
to twelfth grade. I think the evalu- 
ation of it is very simple: Do the 
scores go up? That's the bottom line. 
Do you see an increase in sc(»'es, and 
also do you see some of the residuals? 
Do you see students as better problem 
solvers, and do they feel better about 
themselves, about their ability to 
perform well? 
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"Do the scores go 
up? That's the 
bottom line." 



Mimms: Good. What should be 
the responsibility of each affected 
group in assuring the success of such a 
program— groups such as students, 
parents, teachers? 

McPhail: The students* responsi- 
biUty is to study hard, apply them- 
selves, master the strategies, and 
apply them. The parents' responsibil- 
ity should be to make sure that they 
gain access for their children to this 
kind of training, to make sure that 
once they And a good program that 
they make their children stick to it, 
and to provide the support at home. 

For example, I woik with the 
NAACP to set up testing centers for 
the SAT. I just met with Jiem down 
in Norfolk, Virginia. We're going to 
do the same thing for the NTF. 
Parents had to sign a contrac: tv^hich 
basically said, "We prom'.oe to make 
sure that our students study X number 
of hours to master this material and 
that they will come to every session." 
In other words, the parents* responsi- 
bility is to make sure that the kids are 
accountable to the program, and that 
the program is accountable to the kids. 

As far as teachers and school 
districts are concerned, the bottom hne 
is that they should provide this kind of 
instruction, particularly in Black 
school districts. They should be 
providing this kind of instruction so 
that Black kids can have the same 
benefits as the suburban kids do in 
terms of knowing ho w (o take tests. 

Mimms: All right. What about 
building administrators, the principal 
for instance. 



McPhail: Well, the principal is the 
educational leader and manager of the 
school, and that includes leadership 
for the curriculum. I think the 
principal should make sure that the 
principles of test wiseness are well 
integrated into the curriculum. At the 
elementary level I would like to see 
the principles taught by every class- 
room teacher. At the junior high level 
I would like to see these principles 
taught by whoever is the appropriate 
teacher — the reading teacher or 
English teacher. Then Td like to see 
the content areas focus on aj^lied test 
wiseness, but I still would like to see 
the English teacher or the reading 
teacher focus on didactic instruction in 
the principles of test wiseness. 

At the secondary level I would like 
to see courses called "Preparation for 
the SAT* and "Preparauon for the 
ACT* and "Preparation for the PSAT* 
offered from the seventh grade on. 
Young people would be able to come 
to a class that is pan of their normal 
academic schedule and get specific 
coaching and instruction for the 
College Boards test Then they would 
have the ability to do better on the 
ACT and SAT which will have a 
defmite impact on where they can go 
to school or whether or not they'll get 
a scholarship. 

Mimms: What do you think about 
the role of district administrators 
responsible for staff development, or 
testing and evaluation, or counselors 
and psychologists, or any of those 
people? 

McPbaU: I think all of those 
people are implicated, but I think it's 
the educators A^ho must assure that 
this occurs. I defme the educators as 
the teachers, the principals, and the 
curriculum people. 

Mimms: What about the person 
who is in charge of testing and 
evaluation in the district? 



McPhail: I think that they 
certainly should have an interest in 
this. I think they certainly should be 
supportive of it. They should appreci- 
ate the importance of test wiseness, 
perhaps more than anybody else. But 
I have to say, in my travels aiound the 
counUy tliat I haven *t seen too many 
enlightened testing and measurement 
people in school systems. Tve seen 
people who lend to be conservative 
and who tend really not to be into this 
movement to the degree that I would 
think that they would be. 

Mimms: What is the time frame 
for implementing test-wiseness 
training? Should it be throughout the 
school year or through intensive short 
term training? 

McPbail: It should be throughout 
the school year with intensive short 
term periods before a particular test 
that a student is preparing for, and I 
think you should start when the child 
first comes to school in pre-kindeigar- 
ten. That*s really where it should 
start, and it should be sequenced all 
throughout the child*s twelve or 
thirteen years of public school. 

Mimms: What pitfalls are disuicts 
or schools likely to experience when 
implementing a test-wiseness pro- 
gram, and how can such pitfalls be 
avoided? 

McPbail: Staff development, I 
think, is the major potential pitfall. 
People have to know what ihey*re 
doing. Tve seen a lot of people doing 
things in the name of teaching test 
wiseness as Tve traveled around the 
country which make no sense at all. 
About the worst thing Tve seen is 
ordering the Random House material, 
giving it to kids as homework assign- 
ments, and saying, "We teach the kids 
to be test wise.** Nonsense! 

I think the biggest pitfall is not 
putting enough time, energy, and 
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creativity, and thought into your staff 
development program. The teachers 
really need to be taught what test 
wisenessis. They need to be walked 
through that outline of test-wiseness 
principles. They need to master it, 
and then they need to work with really 
good curriculum people to come up 
with appropriate ^^ehicles in the 
curriculum for delivering those ideas 
to the children and to the students that 
they're working with. I think that 
staff develq)ment and curriculum 
instructional development are two 
areas t'lat have not been approached 
very carefully and can end up being 
big, big pitfalls. 

Mimms: What variables are 
associated with coachable students? 

McPhall: I would say reading 
ability that would be no lower than 
two years below grade level. I would 
say motivation — a, high degree of 
motivation-— and a previous history of 
average to below-average perform- 
ance on standiu'dized tests. Those I 
think would be the most important 
variables. 

Other good candidates would be 
ambitious, bright, aggressive students 
who just wish to do better. Test 
wiseness is really not a remedial 
technique; it*s a technique for every- 
body. There are a lot of kids making 
1300 on the SAT who want to make 
ISOO to up their chances of getting 
into Harvard for whom test wiseness 
would be important also. 

MImms: What are the unique 
needs of certain subgroups of stu- 
dents. Blacks, other ethnic riinorities, 
women, and oth^ language groups? 

McPhail: Blacks in general will 
need a heavy dose of test wiseness, 
not because Blacks are not as bright as 
whites or because Blacks are educa- 
tionally disadvantaged, or whatever 
the case might be. I hope those 
shibboleths are behind us. It*s largely 
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because, as I indicated earlier, a 
multiple-choice, objective kind of 
timed standardized test is a cogni- 
tively inappropriate activity lor a 
possessor of African-American 
cognitive style. I'm convinced of it 
Because of that, I think that our young 
people are really behind the eight ball 
with a lot of these tests. I think that in 
terms of uniqueness there just needs to 
be a lot of attention paid to this. 

There's some research that bears 
this out There's a very good research 
report by Messick'^ who is one of the 
researchers with the Educational 
Testing Service, believe it or not. 
Messick did a re-analysis of the 
Federal Trade Commission data based 
on that law suit of several years ago. 
The Federal Trade Commission 
investigated coaching schools hoping 
to determine that they w^ ripping off 
the public ?'^d not doing things that 
resulted in better test performance, 
only to discovo" that people like 
Stanley Kaplan and others really were 
doing a good job. In his re-analysis of 
this Federal Trade Commission data, 
Messick came upon some truly 
wonderful findings. In two of the 
coaching schools that he looked at 
Black students benefited more from 
the coaching. 

Again, now, just so we're straight 



on terminology, coaching is not test 
wiseness. When I use the term 
coaching, I'm talking about a program 
that includes test wiseness in combi- 
nation with some re-teaching, some of 
it more sophisticated usually, and 
more intensive drill and practice. 
Good coaching encompasses test 
wiseness. 

What Messick found is that Black 
students in two of the coaching 
centers improved m^e substantially 
than did white students who were in 
the same coaching school 'Hiis 
suggests, of course, that the Black 
students were lower in test wiseness to 
begin with, and > also suggests the 
efficacy of this kind of training for 
Black students. 

Mimms: What about ethnic 
groups other than Blacks? Have you 
had any experience or any thoughts 
regarding them and test wiseness? 

McPhail: I work with Blacks and 
Puerto Ricans because those are the 
folks that are in New York and 
Philadelphia. Those are the so-called 
minorities in the inner cities in the 
East where I am from. When I 
worked with Puerto Rican students, I 
found that basically they have the 
same problems as Black students plus 
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the added problem of language 
difficulty. Dq)ending upon where 
they are in terms of their acquisition 
of English, the whole second language 
issue can be a very difficult one for 
them. 

Fortunately most of the Pueno 
Rican students with whom I have 
worked have as much language 
facility as any other American because 
they have lived in America all of their 
lives and somehow they've been able 
to mesh the Spanish and the English. 
They basically know what's hq>pen- 
ing in terms of the English language, 
and so in that regard their needs 
become the same as the needs of 
Black students. 

Of course there are certain cultural 
nuances that are going to come up. 
There are certain questions on tests 
that are purely measures of a particu- 
lar kind of cultural orientation more 
than they are a measure of some kind 
of discrete cognitive skill, and so 
certainly those cultural nuances 
become doubly difficult for persons 
who are bringing such a vastly 
different culture to ttie testing situ- 
ation. For the most part, I found that 
the Hispanic students are able to 
benefit as much from the test-wiseness 
training as are tte Black students. 

Mlmms: What directions do you 
think educators should take in the 
future with regard to test wiseness and 
training in test taking? 

McPhail: We need a lot more 
research. I've not been h^py with 
the quality of the research that's been 
done on the issue of teaching test 
wiseness to Black students. I've 
published some good research in the 
area to which I've gotten some very 
interesting reactions,^^ As my 
career has taken off in academic ad- 
ministration, it*s been difficult for me 
to get out there and collect samples 
and develop matoials and do all these 
great research designs and get all 
those wonderful "p less than .OOP 



probability values. 

I'm kind of disappointed that we 
don't have some researchers who are 
looking at this issue and really doing 
some good research. We need to 
de'-'^Jop a stronger research base so 
thai we have even stronger evidence 
that test- wiseness training works. We 
already know it does. We can look at 
the kids whom we've been able to 
help, for whom it has worked, and we 
can look at my fust experiment and 
the kind of "p" values that I got. Plus 
we can look at that repeat that 
Bangert-Drowns and his associates at 
The University of Michigan wrote that 
listed my study among three or four 

"Our children can 
learn anything if 
taught/' 

which demonstrated defmite benefits 
of teaching test wiseness to Black 
students." 

I think we need a lot more research. 
This is where I'm hoping that PEO 
and all the organizations like }'0urs are 
going to be able to make a marie. We 
need a lot more experimental studies 
in this area. We also probably need 
some ethnographic studies, too, to 
begin to look at attitude change and 
the whole social context of testing for 
Blacks and Puerto Ricans ar?d other 
minorities. As we look to the future, 
that's what I want to see. I want to 
see a much greater invesUnent in basic 
and applied research in test wiseness 
as it impacts on Black students. 

Mimms: What concluding 
thoughts would you like to leave with 
our readers? 

McPhail: Black students can learn 
anything if taught The teaching of 
the principles of test wiseness to 
Black students is a step in the right 



direction. There's no reason to 
believe that literally thousands, 
millions for that matter, of Blacks do 
poorly on tests because of poor ability, 
or deficits, or any of that kind of 
nonsense. Our children can learn 
anything if taught 

It's our responsibility to teacn them 
to be test wise at the same time that 
we're teaching them to read, to use the 
computer, to learn calculus and do all 
of the other things that we want them 
to do. And I think that we need to get 
on with it! 
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Elizabeth M. Mimms 



To Hnd out what states and 
districts in PEO*s service region 
were doing to teach test-taking skills 
to public school students, I conducted 
an exploratory study during Septem- 
ber and October 1987. In 38 brief 
telephone interviews I first defined 
test-taking skills to mean the ability to 
use time well, to pace oneself, to 
know when to guess and when not to 
guess, to use logical reasoning, and 
other factors related to test taking that 
are independent of the test*s content 
Then I asked respondents what their 
agency was doing to train students in 
test-taking skills and specifically 
whether they had develq)ed any 
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training materials for this purpose. 

I spoke with administrators and 
consultants responsible for student 
testing, evaluation, research, or 
assessment from six state agencies and 
32 local districts in PEO*s service 
area: Illinois, Indiana, Michigan, 
Minnesota, Ohio, and Wisconsin. I 
contacted five or six districts per state 
which were either in larije, urban areas 
or were suggested by persons I 
interviewed. 

Other people I talked to in the 
course of my survey included several 
state EEO (Equal Educational Oppor- 
tunity) administrators, district level 
personnel responsible for staff devel- 
opment, counseling and guidance, 
and curriculum and instruction, as 
well as a [nincipal, two university 
professors, two superintendents, and 
two county intermediate school 
district ofHcials. Respondents were 
generous in sharing information, and 
in sending articles, booklets, work- 
shop agendas and other written 
materials in response to my telephone 
inquiries. 



I 

10 Breakthrough ^ ^ Summer 1988 



er|c 



State Agencies 

The Michigan I>epartment of 
Education was the only state educa- 
tional agency to report launching 
systematic efforts to improve student 
test-taking skills. The state office that 
administers the Michigan Educational 
Assessment Program (MEAP) devel- 
oped a brochure for district principals, 
teachers, counselors and ether profes- 
sional staff to use in improving student 
test-taking skills, entitled A Guide to 
Test Taking as Easy as 1 - 2-3,^ 

The state department then refined 
and broadened the brochure to provide 
training for all kinds of tests, including 
teacher made tests. Also, plans were 
underway to use the brochure as the 
basis for developing a videotape for 
tiaining teachers. The efforts in 
Michigan were frequently praised by 
administrators from the five other 
states. 

In Illinois,^ Indiana, and Ohio,' 
administrators said that materials for 
districts to use for improving student 
test-taking skills were being planned in 
conjunction with the development of 
state-wide testing. Administrators 
from Michigan and Ohio added that 
their state departments of education 
included training for teaching test- 
taking skills in their yearly offerings of 
in-service workshops for teachers, 
counselors and other district personnel 
throughout the state. Otherwise, 
systematic efforts to improve student 
test-taking skills were left to the 
discretion of local school districts. 

Local Districts 

Of the 32 local districts I surveyed, 
16 reported making system-wide 
efforts to teach test-t^ng skills. The 
other 16 indicated that they left such 
efforts to the discretion of each school. 
Administrators for 1 1 of these 16 
districts specifically stated that there 
was no system-wide effort to train 
students in test-taking skills in their 



districts. One reported that a 1983 
teacher in-service had indicated a lack 
of staff interest in training students to 
be test wise, and two indicated that 
they, personally, were not in favor of 
such efforts. 

Many districts encouraged teachers 
to prepare students for standardized 
tests by regularly discussing test-taking 
skills and incorporate separate answer 
sheets and multiple-choice formats in 
teacher made tests. A number of 
informants also mentioned commer- 
cially prepared materials. Respondents 
from 12 of the 32 districts reported 
using such practice materials in their 
district. These included commercially 
prq)ared sample questions supplied by 
publishers of specific standardized tests 
including the Iowa Test of Basic Skills 
and the California Achievement Test 
Scoring High * by Random House was 
listed by administrators from five 
districts, and Mini Tests ^ by Educa- 
tional Solutions of New York City was 
reported by two districts. 

IlUnois 

Urbana school district reported a 
system-wide program aimed primarily 
at the elementary level. Teachers 
received one day of in-service training 
and then took students through ten 
lessons that simulated test situations, 
used practice tests and separate answer 
sheets, and stressed time usage, pacing, 
familiarity with routine, checking one's 
own woric, following instructions, self- 
scoring, and discussion of sample tests. 
The purpose of this training was to 
reduce test anxiety and develop a 
positive student attitude. 

The program started as a pilot project 
at Leal Elementary School, where 
materials and training were developed 
by the school's instructional staff and 
by University of Illinois's Professor 
Kennedy Hill. Prof. H«rs research 
has shown that students receiving the 
test preparation program show signifi- 



cant increases in achievment test per- 
formance as well as reduction in test 
anxiety compared to control group 
classrooms.' At this time all of the 
elementary school teachers in the 
Urbana schools have been trained in the 
program as well as all of the teachers in 
Evergreen Park, Illinois, School 
District 

A Chicago adnrinistrator reported 
that some sub-districts have elaborate 
programs and some do not She said a 
study was underway to find out how 
test preparation materials that instruct 
students to read a passage before 
answering reading comprehension 
questions compares in its effectiveness 
to materials that direct students to read 
the questions before reading the 
passage. 



"Students . • . show 
significant increases 
in achievement test 
performance, • 



Michigan 

Detroit has developed a K-12 test 
taking skills manual entitled Testing 
Tune Up? The school-based testing 
coordinate j and other teachers were 
trained in the use of the manual, as are 
new teachers. Requests for this manual 
have come from districts both inside 
and outside the United States. 

Buena Vista school district ne«ir 
Saginaw has developed a txxddot for 
elementary students on how to take 
tests. At the junior high level Buena 
Vista has provided a regular SO-minute 
course on test taking in its communica- 
tion skills sequence. At the high school 
level, ninth graders take a regular 50- 
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minute, one semester class in test- 
taking skills. 

Grand Rapids school district 
initiated its efforts by conducting a 
system-wide survey to see what staff 
thought they needed in order to impart 
test-taking skills to students. This 
school year the district is focusing on 
raising the awareness of staff regard- 
ing test-taking skills and student out- 
comes. One administrator I talked to 
there said, *Test taking is a basic 
skiU." 

Minnesota 

Sl Paul recently provided Dr. Irvitig 
McPhail*s in-service training on test- 
wiseness curriculum to instructional 
staff finom a number of schools that 
had particq)ated in the desegregation 
I^ocess.^^ Teachers then used hand- 
outs and other materials Dr. McPhail 
provided to infuse test-wiseness 
training into their curriculum. In 
addition, teachers developed test 
prq}aration materials for tests wh!ch 
had no practice materials. 

Ohio 

Cincinnati has published a booklet 
on test wiseness that compares 
content-specific and content-free test 
wiseness. C/^Wond Public Schools 
includes sessions on test-taking skills 
in its yeariy group guidance sessions 
for secondary students. Toledo PuWc 
Schools developed test-taking skills 
materials for use with its first through 
third grade students. 

Wisconsin 

Milwaukee regularly tnuns students 
in test-taking skills, especially at the 
elementary level. Materials produced 
by the district and by other sources are 
periodically provided to the schools. 
In addition, the curriculum and 
instruction dq)artment in that district 
brought in Dr. McPhail for a one time 
in-service for principals and supervi- 
sors on infusing test-wiseness training 
into the curriculum. 
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College Admission Tests 

Many districts also provided 
prq>anition for secondary students 
planning to take college entrance tests 
such as the Preliminary Scholastic 
Aptitude Test (PS AT), the Scholastic 
Aptitude Test (SAT), and the Ameri- 
can College Test (ACT). Administra* 
tors for five districts reported making 
self-paced, self-study computer 
software available, free of charge, to 
high school students preparing for 
these exams. 

Administrators from four different 
systems described district-devolrped 
training sessions for students prepar- 
ing for college entrance exams. One 
district offered a 12-session evening 
course. Another had a traLiing unit in 
preparation for the PS AT in all tenth- 
grade English classes in the district 
Two offered optional Saturday 
workshq)s in conjunction with their 
community education departnient and 
the Urban League or NAACP, free or 
at minimal cost to students. 

Conclusions 

It appears that about half of the state 
and educational i^ncics surveyed in 
our six-state region rjt making 
comprehensive eff jrts to promote the 
teaching of test-tak«ng skills in the 
local schools, and a x>ut half are not 
Because we believi. such efforts will 
improve educational opportunities for 
fiudents in this region, we encourage 
all state and local education agencies 
to institute a comprehensive approach 
to te-st wiseness with the necessary 
policy guidelines and programs to 
support staff- and student-level 
training. We agree with our colleague 

Grand Rapids that test takir^ is a 
basic skill. 
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Two and a half years ago adminis- 
trat(»s of a large urban school 
district requested PEO*s assistance in 
planning and implementing a test- 
wiseness program. Irving P. McPhail 
(interviewed elsewhere in this issue) 
was the primary consultant for this 
intervention. 

The district personnel wanted a 
program that would improve student 
test-taking skills in all academic areas, 
and they wanted classroom teachers to 
be able to teach those skills to their 
students. They decided that their 
greatest need was in the elementary 
grades, so a model plan was 
developed to implement test-wiseness 
training for teachers from a select 
number of elementary schools. Eight 
schools were chosen. Some were 
magnet schools and others were state- 
designated effective schools. Once 
successfully implemented, the 
program was to be replicated 
throughout all elementary schools in 
the district 

The Training 

The training consisted of two all- 
day woikshq)s, one in the fall and the 
other in the spring. Eachworicshop 
included a keynote presentation by the 
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consultant followed by a discussion. 
The principals &om the eight schools 
and selected teachers and other staff 
members participated in the training. 

In the &11 wQricshop, Dr. McPhail 
presented his test-wiseness model to 
district participants and then n.et 
separately wi^h teams firom each 
school buikling. By dieendof the 
workshop each buikling team had 
devek)ped a written plan ftv imple- 
menting test-wiseness training at their 
school. For example, one building 
team idanned to present a half-day 
workshop to the rest of the staff in 
their building. 

In the spring workshop, partici- 
pants shared their building plans with 
one anc her and reported on the results 
of their efforts. Then each team met 
separately with the consultant 
Because Dr. McPhail was tempmrily 
unavailable, he reconunended another 
consultant who was an advocate of 
his model to lead this woriuhop. 

After meeting wi A the consultant 
each team developed a building plan 
for test-wiseness training in the 
following school year. For example, 
one team decided to develop addi- 
tional test-wiseness materials fcH* use 
in their school. Another team wrote 
test wiseness into their school effec- 
tiveness plan. Each teacher was 
required to integrate test-wiseness 
training into their classroom curricu- 
lum and to sptt)d fifteen minutes 
every Wednesday teaching test- 
wiseness skills. 



The Results 

The research component of the 
district worked closely with participat 
iiig teachers to measure the impact of 
the test-wiseness program. The 
district usually administered the 
Survey of Basic Skills by Science 
Research Associates (SRA) only once 
a year, but all eight participating 
schools tested their third, fourth, and 
fifth or sixdi grade students twice that 
year. The first test was given in 
October (prior to the fall test-wiseness 
workshop) and the second in May 
(after the spring test-wiseness woit- 
shop). In this way each school could 
compare fall and spring test scores 
and make some judgments about the 
effectiveness of the test-wiseness 
program implemented by their 
teachers. 

In June, each school submitted a 
comparative itpcxt of its fall and 
sjning test scores. Schools whose 
staff members participated ftiUy in the 
test-wiseness project rqx^ed a 
significant increase in SRA test scores 
in all academic areas and grade levels 



. . a significant 
increase in SRA 
test scores in all 
academic areas'' 
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tested. Where there was not full staff 
participation, however, this was not 
the case. For example, only a few 
gains were reported at the primary 
level at one school where many 
faculty were new, first-time teachers 
who were not involved in the fall test- 
wiseness workshop. 

One school reported that the 
improvement in test scores was more 
dramatic for Chapter I students (those 
in the lower qua*.u!e). Another school 
reported a similar dramatic gain for 
students in its behavior problem class. 
The principal of a third school 
reported the following improvements 
in the national percentile rank of his 
students* mean scores on the SRA: 

Grade 2 Grade 3 
Fall 28 39 

Spring 46 63 

The principal of a fourth school, 
whose students had been scoring far 
below the national percentile, reported 
that all students at all grade levels in 
his school had made significant gains 
in the major components of the spring 
test. He presented the Hgures in the 



chart below for the national percentile 
rank of the mean scores of the students 
at his school. 

This same principal reported high 
student interest in the summer activity 
packets that his staff had prepared for 
the students to help them retain and 
strengthen the test-wiseness skills they 
had learned: over 200 students had 
said they would participate in the 
summer test-wiseness program. 

Recommendations 

Although the district judged the 
first year of the test-wiseness training 
program to be a success, it recom- 
mended to PEO and Dr. McPhail that 
any continuation of the program 
should: 

1. Have additional workshops and 
consultations by Dr. McPhail, prefera- 
bly at school building sites where he 
could observe individual teachers 
implementing his test-wiseness 
techniques. 

2. Provide training to ensure that 
gains will continue for previously 



trained students and to involve new 
students who enroll in participating 
buildings. 

3. Start new test-wiseness pro- 
grams in new schools to bring all ele- 
mentary students up to the level of 
those currently participating. 

4. Track specific students from the 
fall test to the spring test, regardless of 
their movement within the district 
(three of the eight selected schools 
had very transient populations.) 

5. Measure whether test-wiseness 
training improves day-to-day perform- 
ance on teacher-made quizzes and 
tests. 

6. Conduct a longitudinal study, 
with a control group if possible, to 
measure whether improvement 
continues over more than one school 
year. 

7. Evaluate the results of the test- 
wiseness intervention for the entire 
district. 

In spite of its success and the 
recommendations for its improvement, 
the test-wiseness training program did 
not continue for a second year. The 
district wanted to continue the 
program, but only if Dr. McPhail 
himself could conduct the workshops 
and consultations. 

Circumstances in the district and 
changes in Dr. McPhail's obligations 
and duties prevented scheduling year 
two of the program. It was both the 
district's and Dr. McPhail's hope, 
however, that the test-wiseness 
training program could continue in the 
near future because the district had 
seen that it was, indeed, a progkam 
that worked. 



One School's National Percentile Ranks 
on the SRA for Fall and Spring 

(iradea Grade 4 firadcS firadcfi 

Composite 

Fall 36 56 55 40 

Spring 56 66 66 50 

Reading Total 

Fall 40 56 56 49 

Spring 70 66 67 54 

Language Total 

Fall 37 56 47 38 

Spring 43 61 57 46 

Math Total 

FaU 37 49 50 38 

Spring 50 65 67 45 
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Who Needs to be Test Wise? 



Bob Croninger 



Should students be taught test- 
wiseness skills? Yes! Some 
students, not necessarily those who 
are less capable, are simply poor test- 
takers. They fail to read directions 
carefully. They waste time on 
questions that stump them. They 
misread contextual clues and use 
faulty guessing strategies. Many of 
these students do poorly on tests, not 
because they are less intelligent but 
because they are poor test-takers. 
Test-taking skills, however, can be 
taught, and when students are taught 
how to take tests better, they also do 
better on tests. 

If tests are to measure the abilities 
of students fairly, then students should 
be taught how to take tests wisely, so 
that every student has an equal 
opportunity to do well. No group of 
students, in other words, should be 
handicapped by beliefs and behaviors 
that are not relevant to the content of a 
test. Tests, after all, are supposed to 
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measure a student's knowledge, not a 
student's test-taking savvy, nor any 
other extraneous characteristic for that 
matter, such as a student's race, 
gender or nation of origin. 

Many educators, of course, agree. 
They argue that students, especially 
at-risk students, who are most often 
ill*prepared for testir.,^, should be 
instructed in how to take tests. They 
should be advised about preparing for 
tests, provided examples of different 
test formats, instructed in different 
test-taking strategies and even 
coached on how to use this knowledge 
when taking specific standardized 
tests. These educators believe that 
poor test taking is a formidable 
obstacle to student success, so they are 
developing instructional materials that 
encourage students to be test wise. 

Parents of at-risk students are 
excited by these initiatives. They 
believe that test wiseness, if property 
^r.\ight and supported by the schools, 

y help their children achieve better 
o: J s on important standardized tests. 
ts)i y<iiars they have noted how testing 
discriminates against their children, 
and they have complained that testing 
denies their children important 
educational opportunities and dam- 
ages self-esteem. Many parents hope 
that their children will now be given 
the chance they deserve to do well in 
school and benefit from their achieve- 
ment 

But as these initiatives are being 
implemented, a second question needs 
to be asked: who else needs to be test 
wise? Is it sufficient, or is it even fair. 



to focus all our attention on the test- 
taking habits of some students? What 
about the test-making and test-use 
habits of parents, teachers, guidance 
counselors, administrators and 
professional test-makers? To ignore 
asking about the test wiseness of these 
people certainly sets students up for 
failure, because it overlooks the 
responsibility of those with the most 
power to influence testing. 

If we are not to **blame the vic- 
tims'* of testing, to use William 
Ryan's now famous phrase, we must 
insist on a much broader definition of 
test wiseness. Test wiseness, in its 
broadest sense, is common sense 
about testing, common sense not just 
about taking tests but about making 
and using tests, too. Test wiseness, in 
other words, is not simply a set of test- 
taking strategies; it is also a body of 
knowledge about how to assess 
accurately, constructively and fairly 
the abilities of children. Test wise- 
ness, therefore, should be a character- 
istic of every aspect of testing. 

Do students need to be test wise? 
Yes! But so, too, do many of the 

"Test wiseness. . . 
is common sense 
not just about 
taking tests but 
about making and 
using tests, too/' 
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other people who influence the conse- 
quences of testing for students. Test 
wiseness is not restricted to the test- 
taking habits of students; it includes 
all aspects of testing, from the 
developing of test items, to the 
selection of tests, to test administra- 
tion, interpretation, and u^. If test 
wiseness is to have significant benefits 
for students, especially at-risk stu- 
dents, then educators must address it 
significantly. The following people, 
therefore, also need to be test wise. 

L Parents must be test wise about 
using tests to assure accountability. 
Parents are pressuring schools to 
improve their curricula and instruc- 
tional practices, and they are mandat- 
ing through local school boards and 
state legislators that schools be held 
accountable for the quality of educa- 
tion they provide students. Since the 
publication of A Nation At Risk, there 
has been a call to "get tough** with 
education. Many schools have 
responded by requiring more and 
more testing of students, including a 
greater emphasis on using test results 
to determine everything from promo- 
tions to curriculum content 

Public schools need to be held 
accountable to the parents of children; 
such accountability has been an 
important impetus to reform and 
change during the last quarter of a 
century. But an excessive emphasis 
on testing will inhibit learning, 
encourage invidious comparisons of 
schools and students, and quite 
possibly harm those who have 
traditionally suffered most from 
testing. Parents have a right to insist 
on accountability, but they should not 
base it solely or perhaps even princi- 
pally on test scores. To do so would 
oversimplify necessary reforms. 

Parents must demonstrate their test 
wiseness by first accepting their own 
responsibility for learning, by motivat- 



"Test wiseness 
will only make 
sense to students if 
they believe that 
testing is fair . . 

ing their children to do well in school, 
and by supporting their efforts in 
whatever way possible. Parents must 
also, however, insist on a broad 
definition of test wiseness, especially 
in schools in which testing is a 
fundamental aspect df the instruc- 
tional program. They must ask for as- 
surances that students will not bear the 
burden of increased testing, that 
administrators, principals, guidance 
counselors and teachers will accept 
their responsibility for fair and 
constructive testing, too. 

2. Teachers must be test wise 
about how test-making and test-taking 
habits afl^ect test results. Ultimately, 
teachers have the most direct effect on 
a student's test-taking habits. They 
affect those habits by how they make 
and present tests to students. If 
teachers approach testing primarily as 
an instructional tool, providing 
students with feedback and oppuituni- 
ties to learn from their mistakes, then 
students are likely to ^proach testing 
as an important aspect of their 
schooling. If, however, testing is an 
isolated event, one used primarily for 
sorting or disciplining, test wiseness 
will not flourish, for students will 
have little opportunity to develop or 
use test-wiseness skills successfully. 

Indeed, when testing is not used as 
an instnictional tool, it often becomes 
adversarial, pitting students against 
students, as well as students against 
teachers. It intensifies testing anxiety, 
because the consequences of testing 



are more serious and irreversible, and 
it increases the animosity students 
have toward schooling because they 
feel unfairly victimized and humili- 
ated by test results. Test wiseness will 
only make sense to students if they 
believe that testing is fair, that they 
will benefit from testing, and that they 
can reasonably influence test results. 

If students are to be test wise, then 
certainly teachers must demonstrate 
good judgment about testing. They 
must make tests that are fair, that 
cover material students can be 
expected to know, that present 
questions cleariy and properly and 
provide adequate time for students to 
do well. They must also thoroughly 
review test results with students, 
pointing out, when possible, test- 
taking habits that interfere with 
students doing well, and they must 
help students adopt test-wiseness 
strategies and provide students with 
opportunities to use those strategies to 
improve their test performance. 

3. Guiuaiice counselors need to 
be test wise about using tests to 
categorize students, identify special 
needs or place students in ability 
groupings. Most of the law suits that 
have been filed against schools for 
testing have argued that test results 
were inappropriately used to deny 
students educaticHial opportunities. 
These suits point to the manner in 
which test results were used to place 
children in ability groupings, special 
education classes or label them as 
intellectually infciior. What has 
alarmed the plaintiffs most in these 
cases is the manner in which many 
students are unable to reverse these 
labels, even after evidence of test 
biases and subsequent performances 
suggest the need to alter the original 
interpretation of test results. 

Because counselors are often 
responsible for student records, as 
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well as the use and interpretation of 
certain diagnostic tests, they have a 
special responsibility in this regard. 
They must assure that test results do 
not become the basis for self-fulfilling 
prophecies that encourage academic 
failure or foster restrictive stereotypes. 
Guidance counselors, therefore, must 
demonstrate their test wiseness by 
assuring that test results are not the 
sole factor used in categorizing an^ 
placing students, and where evid(»ice 
of test bias exists, counseled should 
assure that test results are not a factor 
at all. 

Minimally, therefore, guidance 
counselors should pay special atten- 
tion to the manner in which test results 
are recorded in students' records and 
presented to interested others. They 
should assure that other diagnostic 
factors, such as anecdotes and 
observations from classroom teachers, 
as well as information about potential 
test biases, are included in the records, 
especially when this information 
contradicts or tempers interpetations 
that may exclude students from 
opportunities afforded other children. 
Guidance counselors should also 
dissuade others from using test results 
that may be biased against certain 
groups of students. 

4. Principals need to be test wise 
about effective instruction and using 
tests to measure achievement Princi- 
pals are the instructional leaders of 
their schools. They set the tone for 
teaching and learning. As with 
effective schooling or any other set of 
desired outcomes, principal support is 
an important predictor of success. 
They can establish an atmosphere in 
which achievement is highly valued 
and students are motivated to do well 
on tests. They can set standards for 
testing, and they can provide opportu- 
nities for staff to develop and improve 
knowledge and skills basic to those 
standards. 



Principals can demonstrate their 
test wiseness by assuring that students 
receive the best and most effective 
instruction possible, ia^struction that 
prepares students for the content of 
tests without iniq>propriately narrow- 
ing the curriculum. In doing so 
principals acknowledge the school's 
responsibility for learning, and they 
place testing in its proper role, as a 
means to improve learning, not an end 
to itself. By establishing a positive, 
well-balanced climate for achievement 
and testing, principals can do much to 
encourage the test wiseness of 
students, parents, teachers and other 
school personnel. 

5. District administrators need to 
be test wise about the potential 
misuses and abuse of testing. Many 
educational reforms launched during 
recent years have included provisions 
for increased testing of students. 
District administrators and school 
board members are under increased 
pressure to demonstrate progress, and 
to do so many are turning to standard- 
ized tests and other exams as a way to 
evaluate programs and assure ac- 
countability. Without safeguards, 
however, stiidents, especially at-risk 
students, are likely to be victimized by 
these pressures and testing practices. 

As testing becomes a more promi- 
nent part of a district's educational 
program, administrators should 
acknowledge their responsibility for 
assuring that test results are properly 
used. The guidelines and policies that 
they set should demonstrate their 
commitment to test wiseness, not just 
for students but for all school person- 
nel. They should set the tone for 
testing in the district, clearly stating its 
proper and improper uses, as well as 
the safeguards to be established for 
assuring that student ability is accu- 
rately and fairly assessed. 

Minimally, administrators need to 



demonstrate their test wiseness by 
setting policies that assure the open 
review of testing practices and results, 
require careful consideration of 
potential biases when selecting tests 
and assign personnel to evaluate the 
educational effiects of testing for 
students, particularly those most 
vulnerable to test abuse. Being test 
wise, in this regard, requires a clear 
undmtanding of the limitations of 
testing technology, of what can be 
properly accomplished by it and what 
policies protect students from test 
misuse and abuse. 

6. Finally, professional test- 
makers must be test wise about how 
their tests affiect students and their 
schooling. Standardized tests have 
become exceptionally important in the 
educational life of students. At an 
early age, say six or seven, most 
students are given some form of a 
standardized test Their performance 
is then compared to those of other . 
students, ami opinions are formed 
about their actual and potential 
abilities. During the next ten tc 
fifteen years, they will take more tests, 
especially those students who compete 
with others for the most prized 
educational opportunities. Students 
who do well vrill be rewarded with 
new chances to learn and advance; 
those who do poorly will not 

Standardized tests art a powerful, 
if not ubiquitous, aspect of contempo- 
rary schooling. They are used widely 
to assess the strengths and weaknesses 
of individual students, to identify 
specific cognitive difficulties, to 
measure the impact of educational 
programs, and to select students for 
competitive rewards and learning 
opportunities. But where diere is 
widespread use, there is also wide- 
spread responsibility* and those who 
must bear respon^^ibility are those who 
develop tests and pxsent them as a 
benign, credible anJ objective 
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measurement of educational ability. 
Indeed, there is probably no group of 
people beuer suited to perform this 
task* for there is no other group that 
has specific information about test 
development and potential biases. 

Professional test^makers, therefore, 
must be test wise. They must recog- 
nize the dangers that tests pose to 
students when they are misused, and 
they must prevent misuses by making 
the facts about their tests less mysteri- 
ous, remote and difficult to under- 
stand. Test-makers, in other words, 
must provide students, parents and 
educators important consumer 
information. They must warn about 
the misuses of testing and provide 
clear, understandable examples of 
appropriate and inappropriate uses. 
They must guard against potential 
biases in test content, noting discrep- 
ancies in scores that reflect gender, 
racial, ethnic or linguistic differences, 
and they must suggest alternative 
ways of accurately measuring the 
abilities of these students. 

Standardized tests are a mixed 
blessing. They provide important 
educational information about 
students, information that can be used 
to benefit or harm children. Obvi- 
ously, test-makers cannot be held 
responsible for every misuse or abuse 
of testing. They cannot guarantee that 
educators, be they classroom teachers 
or college professors, will u^^e stan- 
dardized tests responsibly. They can, 
however, guarantee that parents, 
students and educates^ have the 
information they need to make 
responsible, informed decisions about 
testing. And this they should do. For, 
ultimately, the misuses and abuse of 
testing can only be prevented by an 
informed educational community 
. . . a test-wise community. 



A Test-Wiseness Primer 



D. Groves Dugger 

In 1987 nearly 1.8 million high 
school students took either the 
Educational Testing Service's Scho- 
lastic Aptitude Test (SAT), or the 
American College Testing Program's 
American College Test (ACT), an 
increase of approximately seven 
percent from 1986.' National, state, 
and local education policy makers 
have expanded the use of competency, 
achievement, college admissions and 
other standardized tests. Tests now 
evaluate not only student performance, 
but also the perfonnance of their 
teachers, educational programs and 
even entire districts. 

In response, many educators have 
begun to implement test-wiseness 
programs designed to improve their 
students* test-taking skills. These 
programs can be relatively inexpen- 
sive, reqmie a minimal amount of 
time, and are considered an ethical 
means of improving test scores. As 
evaluation specialist Jarold Zacharius 
stated, "If you're going to be involved 
with these tests, it would be stupid not 
to engage in test-taking instruction."' 
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Millman's Theory 
of Test Wiseness 

The cornerstone theoretical work in 
test wiseness was done by Millman, 
Bishop and Ebel in 1965. Millman 
deflned test wiseness as **a subject's 
ciQiacity to utilize- the characteristics 
and formats of the test and/or the test- 
taking situation to receive a high 
score. Test wiseness is logically 
independent of the examinee's 
knowledge of the subject matter for 
which the items are supposedly 
measures."' 

According to Millman, test 
wiseness is divided into two major 
categories, strategies independent of 
the test constructor 

1) time use 

2) error avoidance 

3) guessing and 

4) deductive reasoning 

dxidstxBJtdgies dependent on the test 
constructor 

1) intent consideration and 

2) test cue using.^ 

Objective and Subjective Tests 
It would seem that most test- 
wiseness strategies are primarily 
applicable to closed-ended, objective, 
multiple-choice exams. In fact, 
Samacki, in his re view of research, 
found that scores on many respected 
standardized tests, such as the Califor- 
nia Achievement Test, Metropolitan 
Achievement Test, Stanford Reading 
Test and the Iowa Test of Educational 
Develq)ment can be improved by the 
ai^lication of test-wiseness skills.^ 
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According to Samacki, test- 
wiseness is not limited to objective 
tests because time-using and error- 
avoidance strategies are also appli- 
cable to more subjective tests, such as 
essay examinations. Furthermore, 
knowledge of the test constructor's 
intent and idiosyncrasies in test 
making and grading will help the 
examinee do better in many testing 
situations.^ 

Subject Matter 

Regardless of the subject matter, 
test scores can be improved by 
teaching test-wiseness skills. Samacki 
reports that language, math, word 
knowledge, science, vocabulary, 
analogies, correcmess of expression, 
general information, and reading are 
all sensitive to test-wiseness strate- 
gies.^ 

That test-wiseness skills work with 
ary test content was aptly demon- 
strated by Bajtelsmit in 197S. He 
used a testing instrument with 
"content-free" (nonsensical) items, in 
which the correct answer could only 
be derived through the application of 
certain test-wiseness strategies." 

Methods and Duration 

Test-wiseness strategies have been 
successfully taught by a variety of 
methods including supervised study, 
independent reading, programmed 
instruction, and mail correspondence 
courses. All can provide some 
competency in tesi-wiseness skills.' 

Most test-wiseness research 
suggests that test-wiseness programs 
need not be long in duration to 
produce gains. In fact, most instruc- 
tional lessons used in test-wiseness 
research studies lasted no longer than 
one to two hours 

However, it seems that the most 
signifcant gains result from five to 
seven week test-wiseness programs. 
In Samson's 1985 meta-analysis of 



74 research studies, the largest mean 
effect size occurred when the instruc- 
tional program lasted between five 
and seven weeks." Bangert-Drowns, 
Kulik, and Kulik found similar results 
in their 1983 meta-analysis of 30 
studies.'^ These studies showed that 
there are realistic limits on the 
improvement that can be made and 
diminishing returns with increasing 
investments of time.'^ 

Mcssick and Jungeblut also 
observed that improvement in compre- 
hension and reasoning skills, as 
measured by the SAT, require 
geometrically increasing amounts of 
time and effort. This suggests that the 
time required to achieve average score 
increases greater than 20 or 30 points 
on a test similar to the SAT rapidly 
approaches that of full-time school- 
ing.** 

Verbal Achievement 

Verbal achievement as measured 
on the SAT verbal scale was strongly 
correlated with test-wiseness." This 
finding was replicated by other re- 
searchers who observed strong corre- 
lations between verbal ability and test 



wiseness as measured on the Iowa 
Basic Skills Battery.'^ 

Interestingly, when students with 
strong verbal and reading skills were 
compared to students with less devel- 
oped verbal and reading skills, they 
did not exhibit as dramatic improve- 
ments in scoring. Participants with 
strong skills had less room to improve, 
while participants at lower verbal 
skill levels attained skills that were 
already part of the better students' 
cognitive arsenal. 

Age and Grade 

Age and grade have also been 
examined as potential corelates of test 
wiseness. Researchers have discov- 
ered that as student grade level 
increases so does performance on test- 
wiseness scales. This relationship 
between grade and performance on 
test-wiseness scales begins to diminish 
during the high school years, however, 
leading many researchers to propose 
that at a certain point in a student's 
educational experience, particularly 
the high school years, the school 
cohort becomes relatively homogene- 
ous in test-wiseness due to maturation. 
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experience and a general desire to 
achievc.^^ Others suggest that as the 
age or grade of the student increases, 
deductive itasoning skills become 
more developed^* 

Lasdy, other researchers have 
suggested that exposure to numerous 
tests and test formats, which is a 
fundamental test-wiseness concept, is 
directly correlated with experience and 
age.^' Although many researchers 
have concluded that die acquisition of 
test-wiseness skills may be most 
useful for certain age groups or 
devebpmental periods, test-wiseness 
skills benefit people of all age 
groups." 

SES and Race 

Researchers have found that low 
socio-economic status (SES) students 
in urban school settings are particu- 
larly recq)ti ve to acquiring test- 
wiseness skills and these students tend 
to be members of minority groups. 
The ability to acquire test-wiseness 
skills, however, is not related to race 
but to other factors previously 
discussed* such as verbal and reading 
skill. Because urban schools generally 
have larger student populations with 
moderate verbal and reading skills, 
students in these schools fit the most 
coachable student profile.^ 

Anxiety and Motivation 

The two most prominent variables 
demonstrated to be negatively 
correlated with test-wiseness are test 
anxiety and testee motivation. Test 
anxiety and motivation i^y critical 
rolea in the examinee's test perform- 
ance and are the greatest sources of 
variance in ail exam situations and 
test-wiseness research.^ 

Some research has suggested that 
Black students tested by Black 
proctors receive higher test scores than 
Black students tested by white 
proctors. Pertiaps Black students 



tested by Black proctors experience 
less stress and anxiety. The "psycho- 
logical state** of the examinee plays an 
integral role in test performance.^ 

According to Hill, debilitating test 
anxiety and odier factors (including 
inherent test biases and differential 
test-taking skills) may cause standard- 
ized tests to measure students* testing 
skills rather than their ability, knowl- 
edge, or the effectiveness of their 
educational programs.^ 

DurabOity and 

Broad Based ApplicabQity 

Although most researchers believe 
that test-wiseness skills can be taught 
to a broad q)ectrum of ages, most also 
agree that reinforcement of test- 
wiseness skills is essential to ensure 
the durability of these skills. One 
study of adults discovered that test- 
wiseness skills developed after years 
of testing declined wiih the passage of 
time, and that skills acquired through 
years of test-takuig, across all aca- 
demic levels, dissipated with years of 
non-testing, resulting in the inability 
to test well later in life.^ 

Although all test-wiseness pro- 
grams may not be q)plicable to ouier 
tasks outside of test-taking, some 
researchers believe that test-wiseness 
programs designed to provide broad 
based cognitive skill development are 
iqjplicable to other tasks. Deductive 
reasoning and item cue strategies 
focus on the examinee, and these 
strategies can be useful outside of the 
testing situation. They emphasize 
alternative means of reasoning and 
thinking which broaden cognitive 
abilities by providing new means of 
processing information ^iciently and 
accurately. 

Research suggests that the global 
utility of test-wiseness skills is 
important and should be formally 
addressed. Broad based cognitive 



test-wiseness skills assist in training 
individuals to think and reason in an 
integrated fashion. Messick probably 
states the importance of broad-based 
test-wiseness training most eloquently: 
"The most rational means to prepare a 
student for standardized tests would be 
to develop a secondary school 
curriculum which emphasizes the 
development of thought as well as 
knowledge.**^ 

Test VaUdity 

In simi, test-wiseness training can 
ensure greater homogeneity of the 
test-wiseness trait among test takers. 
If students know how to take the test, 
then their performance will be based 
on what Jie test was supposed to 
measure, increasing test validity. 

Jongsma states that "virtually all 
authorities in educational measure- 
ment recognize test wiseness as a 
source of variance on educational 
tests. Most would also agree that 
variance due to test wiseness is 
undesirable in that it reduces the 
validity of the test."^ 

The implementation of a broad 
based test-wiseness skill development 
program is nota panacea. The 
teaching of test-wiseness skills will 
rarely produce dramatic, significant 
increases in student test performance. 
Test wiseness will, however, provide 
another level of expertise that will 
reduce a student's test anxiety, 
improve inductive and deductive 
reasoning skills, and broaden his or 
her cognitive abilities. 

Most importantly, the implementa- 
tion of a broad based test-wiseness 
skill development program will 
equalize the testing skills of students. 
This will subsequently provide more 
accurate assessments of student 
ability, student knowledge, and 
curriculum and program effectiveness 
to students, administrators, and policy 
makers. 
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Services in the 
Area of Testing- 

Aurora Ramirez-Krodel, 
PEO librarian 

American College Testing (ACT) 

Program 

Box 168 

Iowa City. Iowa 52243 
(319) 337-1000 

Provides guidance oriented assessment 
and research programs for students, 
secondary schools, universities, 
vocational-technical institutes, and 
scholarship agencies. The ACT As- 
sessment Program, which consists of a 
profde questionnaire, interest inven- 
tory, and four 30-50 minute tests in 
English, mathematics, social studies, 
and natural sciences, is used by 
aiq)roximately one million students 
annually. ACT also provides resident 
and contract services to educational 
institutions, organizations, and 
agencies. 
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Association for Measurement and 
Evaluation in Counseling and 
Development (AMECD) 
S999 Stevenson Division 
Alexandria, VA 22304 
(703) 823-9800 

A division of the American Associa- 
tion for Counseling and Development 
(AACD) for people who plan, admini- 
ster, and conduct testing programs, 
provide test scoring services, interpret 
and use test results, and develop 
evaluation instruments. The division 
identifies problems in the use of 
evaluation tools, promotes research 
concerning these problems, dissemi- 
nates research results, and provides a 
forum for exchange of concerns. 

Boston University 
School of Education 
Center for Assessment & 
Design of Learning 
60S Commonwealth Avenue 
Boston, MA 02215 
(617) 353-2699 

Concerned with educational assess- 
ment and the prescriptive planning 
process; assesses students with an 
individually planned, research-based 
battery of reading and language tests 
and selected cognitive and affective 
measures. Conducts follow-up studies 
of clients served and evaluates the 
assessment and prescriptive process. 

Educational Records Bureau (ERB) 
Bardwell Hall 
37 Cameron Street 
Wellesley,MA 02181 
(617)235-8920 

Provides measurement services and 
research to member schools, helping 
them obtain reliable and comparable 
measurements of the abilities and 
academic achievements of their 
students. Plans organized testing 
programs, scores tests, reports results 
to schools, prepares normative data, 



maintains cumulative records of 
scores, conducts research on test 
results, publishes research reports on 
testing and assists schools in using test 
results in instruction and guidance. 
Evaluates school testing programs and 
provides in-service training of staff. 
Serves as an independent evaluation 
agency. 

Educational Testing Service (ETS) 
Midwest 

One i\merican Plaza 
Evanston, IL 60201 
(312)869-7700 

Develq)s and administers tests, 
conducts research on all aspects of 
testing and test use, and develops test 
preparation aids. 

ERIC Clearinghouse on 

Tests, Measurement and Evaluation 

Educational Testing Service 

Rosedale Road 

Princeton, New Jersey 08541 

(609) 734-5176 

.\rchives information on tests and 
other measurement devices; methodol- 
ogy of measurement and evaluation; 
application of tests, measurement, or 
evaluation in educational projects or 
programs; research design and 
methodology; and learning theory in 
general. 

FairTest 

National Center for Fair and Open 
Testing 

Box 1272 

Harvard Square Station 
Cambridge, MA 02238 
(617) 8644810 

Rest^arch and advocacy organization 
dedicated to ensuring that the 40 
million standardized testadminist^ed 
annually to America's students and 
job applicants are fair, open, and edu- 
cationally sound. 



National Assessment of 
Educational Progress (NAEP) 
CN 6710 

Princeton, NJ 08541 
(609) 734-1624 

A program of Office of Educational 
Research and Improvement (OERI), 
U.S. Dept of Education, under a grant 
to ETS. Provides ctiisus-like data on 
educational levels. Conducts national 
assessments in major learning areas. 
Reports results to public and educa- 
tional decision makers. 

National Council on Measurement 
in Education (NCME) 
1230 17th Street, N.W. 
Washington, D.C. 20036 
(202)223-9318 

Test publishers, educational measure- 
ment specialists, and educatcx^ inter- 
ested in measurement of human 
abilities, po^naHty characteristics 
and educational achievement and in 
procedures appropriate for the 
interpretation and use of such meas- 
ures. 

Western Michigan University 
Evaluation Center 
Ellsworth Hall 401 B 
Kalamazoo, MI 49008 
(616)383-8166 
Conducts program evaluations, 
develops tests and oiticr measurement 
instruments, and conducts studies in 
the areas of decision making, informa- 
tion usage, and OTganizational pat- 
terns. Evaluates government and 
school district programs and develops 
and tests evaluation theories and 
standards. 

Sources* 

Encyclopedia of Associations. 6th ed. 
Margaret Fisk, editor. Detroit Gale 
Research Co., 1988. 

Research Centers Diret tOf y\ Detroit: 
Gale Research Co., 1988. 
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Protrams for Educational Opportunity (PEO)isa 
combined race, gender, and national origin desegregation as- 
sistance center funded by the U. S. Department of Education 
under Title IV of the 1964 Civil Rights Act PEO provid^^ 
technical assistance without charge to eligible public school 
districts in the states of Illinois, Indiana, Michigan, Minne- 
sota, Ohio, and Wisconsin to develop programs that promote 
equity and remove discriminatory practices. Please write or 
call us at the address or teiephone given below if you would 
like to know more about our services. 

Breakthrough is a periodic publication of PEO highlighting 
educational issues and effective approaches for enhancing 
equity and excellence through planned change. Its contents 
do not necessarily reflect the position or policy of the 
Department of Education and no endorsement should be 
inferred 
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